Systems and methods for mixed reality transitions

ABSTRACT

An immersive video display system includes a video display to display an image and a processor coupled with the video display. The displayed image includes an augmented reality image and a virtual reality image at different moments in time. The processor is to modify one of the augmented reality image and the virtual reality image to more closely correspond to the other of the augmented reality image and the virtual reality image, and control the video display to gradually transition from displaying the one of the augmented reality image and the virtual reality image to the other of the augmented reality image and the virtual reality image.

TECHNICAL FIELD

Embodiments described herein generally relate to computing, and inparticular, to systems and methods for mixed reality transitions.

BACKGROUND

A virtual reality environment presents a viewer with acomputer-generated world with which the viewer may interact. Such avirtual reality environment is typically presented to the viewer via apair of head-mounted displays, one for each eye, that present athree-dimensional (3D) image to the viewer. The head-mounted displayalso typically includes sensors to sense the viewer's head movements sothat the viewer may explore the virtual reality environment by turningthe viewer's head in a similar fashion as in the real world. Thus, forexample, the viewer may look left or right in the virtual world byturning the viewer's head left or right, respectively.

An augmented reality environment presents a viewer with a limited amountof computer-generated objects that overlay onto the viewer's real-worldview. The augmented reality environment may be presented to the vieweralso via a pair of head-mounted displays, one for each eye, that presenta 3D image to the viewer. The head-mounted displays may be transparentto allow the viewer to optically view the real world while thecomputer-generated objects are overlaid via the displays, or thehead-mounted displays may display live images of the real world capturedby video camera mounted proximate the head-mounted displays combinedwith the computer-generated objects overlaid onto the live images of thereal world.

BRIEF DESCRIPTION OF THE DRAWINGS

In the drawings, which are not necessarily drawn to scale, like numeralsmay describe similar components in different views. Like numerals havingdifferent letter suffixes may represent different instances of similarcomponents. Some embodiments are illustrated by way of example, and notlimitation, in the figures of the accompanying drawings, in which:

FIG. 1 is a block diagram illustrating an augmented reality/virtualreality system, according to an embodiment;

FIG. 2 is a block diagram illustrating an augmented reality/virtualreality display system, according to an embodiment;

FIG. 3 is a block diagram illustrating a display controller, accordingto an embodiment;

FIG. 4 is a diagram illustrating a transition from a virtual realityrepresentation of a real-world environment to an augmented realityrepresentation of the real-world environment, according to anembodiment;

FIG. 5 is a diagram illustrating expansion of spaces within a virtualreality environment to match viewer perceptions of reality as may beexperienced in an augmented reality environment, according to anembodiment;

FIG. 6 is a flow chart illustrating a method of transitioning from oneof an augmented reality environment and virtual reality environment tothe other of the augmented reality environment and virtual realityenvironment, according to an embodiment:

FIG. 7 is a flow chart illustrating a method of transitioning from avirtual reality environment to an augmented reality environment,according to an embodiment;

FIG. 8 is a flow chart illustrating a method of transitioning from anaugmented reality environment to a virtual reality environment,according to an embodiment; and

FIG. 9 is an example machine upon which any of the techniques (e.g.,methodologies) discussed herein may perform, according to an exampleembodiment.

DETAILED DESCRIPTION

In the following description, for purposes of explanation, numerousspecific details are set forth in order to provide a thoroughunderstanding of some example embodiments. It will be evident, however,to one skilled in the art, that the present disclosure may be practicedwithout these specific details.

Disclosed herein are systems and methods that provide for mixed realitytransitions in an augmented reality/virtual reality (AR/VR) displaysystem. A scene in front of a wearable digital camera may be presentedto a viewer by the AR/VR display system in either a virtual reality (VR)display mode or in an augmented reality (AR) display mode. Furthermore,the AR/VR display system may adjust a level of viewer immersion in a VRor AR environment and switch between one of the AR and VR modes to theother of the AR and VR modes based upon various contextual factors,e.g., a context in which the AR/VR display system is being used, changesin the environment, the viewer's activity and schedule, etc. Inaddition, since the AR/VR display system differentiates between the ARmode and the VR mode for the same scene, the AR/VR display system maymake adjustments to the displayed image when transitioning between oneof the AR and VR modes to the other of the AR and VR modes in order tomake the transition smoother and more natural for the viewer, therebymaintaining a continuity of flow of the viewer's experience.

For example, a viewer may be walking to a train while wearing a headsetthat is an embodiment of the AR/VR display system. The viewer may beplaying an AR game using the headset in which small creatures seem to beflying around in the real-world environment surrounding the viewer.Because the viewer is walking, the AR/VR display system may limit theamount of interaction with the viewer and the amount of immersion thatthe viewer may experience. When the viewer sits down in the train, andthe viewer is more available to concentrate on the game using the AR/VRdisplay system without needing to pay attention to the viewer'senvironment to walk safely, the AR/VR display system may detect thiscontextual change. The AR/VR display system may detect this, and perhapsalso that no one is sitting nearby the viewer, through the use of amotion detector, a proximity detector, a global positioning system (GPS)location, scene recognition from a set of world-facing digital camerasmounted on the AR/VR display system, a calendar schedule of the viewer,or any combination of these and the like. The AR/VR display system maythen transition to a more immersive VR experience for the viewer, forexample, a fully immersive VR gaming experience that is not limited tothe viewer's surrounding environment within the train. As the viewernears the train stop at which the viewer will disembark from the train,the AR/VR display system may gradually exit the fully immersive VRgaming experience and begin to add elements of the viewer's surroundingreal-world environment to the viewer's experience. The AR/VR displaysystem may adjust the narrative of the VR game or otherwise alter theuser experience of the VR game in the process, in order to accommodate agradual transition from the fully immersive VR mode to the AR mode andmaintaining a continuity of flow of the viewer's experience.

FIG. 1 is a block diagram illustrating an AR/VR system 100, according toan embodiment. The AR/VR system 100 may include a video display 102 anda server 150. The AR/VR system 100 may be installed and executed at alocal site, such as at an office or home, or installed and executed froma remote site, such as a data center or a cloud service. Portions of theAR/VR system 100 may run locally while other portions may run remotely(with respect to the local elements). The video display 102 may becommunicatively coupled with the server 150 via a hardwired connection(e.g., DVI, DisplayPort, HDMI, VGA, Ethernet, USB, FireWire, AV cables,and the like), or via a wireless connection (e.g., Bluetooth, Wi-Fi, andthe like).

The video display 102 may include any type of electronic or computingdevice, including but not limited to a laptop, smartphone, wearabledevice, tablet, hybrid device, or the like. The video display 102 mayinclude a transceiver 106, capable of both sending and receiving data,and be controlled by a controller 108. The transceiver 106 andcontroller 108 may be used to communicate over various wirelessnetworks, such as a Wi-Fi network (e.g., according to the IEEE 802.11family of standards); cellular network, for example, a network designedaccording to the Long-Term Evolution (LTE), LTE-Advanced, 5G, or GlobalSystem for Mobile Communications (GSM) families of standards; or thelike.

The video display 102 may include Bluetooth hardware, firmware, andsoftware to enable Bluetooth connectivity according to the IEEE 802.15family of standards. In an example, the video display 102 includes aBluetooth radio 110 controlled by Bluetooth firmware 112 and a Bluetoothhost 114.

The video display 102 may include a left display monitor 122 to displayan image to a left eye of a viewer 104, and a right display monitor 124to display an image to a right eye of the viewer 104. However, thisshould not be construed as limiting, as in some embodiments, the videodisplay 102 may include only one video display, which may display bothan image associated with the left eye and an image associated with theright eye of the viewer, or may display a two-dimensional (2D) image ona set of display monitors.

The video display 102 may also include a set of sensors 120. The sensors120 may include a digital still camera or video camera to receive imagesof the environment adjacent to or surrounding the video display 102 orwithin a line of sight of the video display 102, e.g., the environmentadjacent to or surrounding the viewer 104 or within a line of sight ofthe viewer 104 when the viewer 104 is using the video display 102. Theenvironment may be considered to be adjacent to the viewer 104 when theviewer 104 can touch or interact with the environment, e.g., when theviewer is seated near another person on a train and can touch thatperson or have a conversation with that person. The environment may alsobe considered to be surrounding the viewer 104 when the viewer 104 isable to see the environment, e.g., when the environment is within a lineof sight of the viewer 104. The displayed image may be modified toincorporate a representation of the image of the environment within aline of sight of the video display 102.

The sensors 120 may also include a microphone to receive audio of theenvironment. The sensors 120 may also include a motion detector, e.g.,an accelerometer, to detect movement of the video display 102, e.g.,movement of the viewer's head when the viewer 104 wears the videodisplay 102 as a head mounted video display. The motion detector mayalso detect other movements of the viewer 104, e.g., the viewer 104sitting down, standing up, or head turning. When the viewer 104 isdetected as sitting down, the video display 102 may transition fromdisplaying the AR image to the VR image. When the viewer 104 is detectedas standing up, the video display 102 may transition from displaying theVR image to the AR image. When the viewer's head is turned, the videodisplay 102 may display a different portion of a virtual or augmentedreality environment corresponding to the displayed image consistent withvirtually turning a head of a virtual viewer within the virtual oraugmented reality environment.

The sensors 120 may also include a proximity sensor to detect proximityof the video display 102 to people or objects in the real-worldenvironment surrounding the video display 102. The sensors 120 may alsoinclude one or more of temperature sensors, humidity sensors, lightsensors, infrared (IR) sensors, heart rate monitors, vibration sensors,tactile sensors, conductance sensors, etc., to sense the viewer'sactivities and current state, accept input, and also to senseinformation about the viewer's environment. Based on whether a person isdetected to be adjacent the video display 102 or the viewer 104, thevideo display 102 may be controlled to gradually transition fromdisplaying one of the augmented reality image and the virtual realityimage to the other of the augmented reality image and the virtualreality image. For example, when a person is detected to be adjacent thevideo display 102 or the viewer 104, the video display 102 may becontrolled to gradually transition from displaying the virtual realityimage to displaying the augmented reality image, or be prevented fromtransitioning to display the virtual reality image.

An operating system 116 may interface with the controller 108 andBluetooth host 114. The operating system 116 may be a desktop operatingsystem, embedded operating system, real-time operating system,proprietary operating system, network operating system, and the like.Examples include, but are not limited to, Windows® NT (and itsvariants), Windows® Mobile, Windows® Embedded, Mac OS®, Apple iOS, AppleWatchOS®, UNIX, Android™, JavaOS, Symbian OS, Linux, and other suitableoperating system platforms.

A communication controller (not shown) may be implemented in hardware,in firmware, or in the operating system 116. The communicationcontroller may act as an interface with various hardware abstractionlayer (HAL) interfaces, e.g., device drivers, communication protocolstacks, libraries, and the like. The communication controller isoperable to receive user input (e.g., from a system event or by anexpress system call to the communication controller), and interact withlower-level communication devices (e.g., Bluetooth radio, Wi-Fi radio,cellular radio, etc.) based on the user input. The communicationcontroller may be implemented, at least in part, in a user-levelapplication that makes calls to one or more libraries, deviceinterfaces, or the like in the operating system 116, to causecommunication devices to operate in a certain manner.

A user application space 118 on the video display 102 is used toimplement user-level applications, controls, user interfaces, and thelike, for the viewer 104 to control the video display 102. Anapplication, app, extension, control panel, or other user-levelexecutable software program may be used to control access to the videodisplay 102. For example, an executable file, such as an app, may beinstalled on the video display 102 and operable to communicate with ahost application installed on the server 150.

The server 150 may include an operating system, a file system, databaseconnectivity, radios, or other interfaces to provide an AR/VR system tothe video display 102. In particular, the server 150 may include, or becommunicatively connected to, a radio transceiver 152 to communicatewith the video display 102. A respective controller 154 may control theradio transceiver 152 of the server 150, which in turn may be connectedwith and controlled via an operating system 156 and user-levelapplications 158.

In operation, the viewer 104 may interact with an AR environment or VRenvironment using the video display 102. Details regarding the viewer,the viewer's schedule, and the AR environment or VR environment arestored at the server 150. The server 150 may store the details in a datastore 160. The data store 160 may be located at the server 150 or at aremote server (e.g., a database server). The server 150 may provide areminder to the viewer 104 about the viewer's schedule, such as with anotification or other mechanism. The server 150 may also receivelocation information from the video display 102, which may betransmitted on a recurring or periodic basis, on demand, or by othermeans. The location information may be used by the server 150 todetermine the location of the video display 102 and inferentially thelocation of the viewer 104 of the video display 102. Based on thelocation information, the server 150 may determine details of theviewer's status. Further details are provided in the following figuresand description.

FIG. 2 is a block diagram illustrating an AR/VR display system 200,according to an embodiment. The AR/VR system 200 includes acommunications interface 202, a database interface 204, a video display206, sensors 210, and a processor 212. The database interface 204 may beused to access a real-to-VR adjustment database 208, which may beco-located with the AR/VR system 200 or remote from the AR/VR system200.

The communications interface 202, database interface 204, video display206, sensors 210, and processor 212 are understood to encompass tangibleentities that are physically constructed, specifically configured (e.g.,hardwired), or temporarily (e.g., transitorily) configured (e.g.,programmed) to operate in a specified manner or to perform part or allof any operations described herein. Such tangible entities may beconstructed using circuits, such as with dedicated hardware (e.g., fieldprogrammable gate arrays (FPGAs), logic gates, graphics processing units(GPUs), digital signal processors (DSPs), etc.). As such, the tangibleentities described herein may be referred to as circuits, circuitry,processor units, subsystems, or the like.

The communications interface 202 may be coupled to a radio transmitter,and be operable to communicate with an embodiment of the server 150, orvarious other servers and devices external to the AR/VR display system200, e.g., via the Internet.

The database interface 204 may be configured to access a set ofdatabases to receive data and/or to provide data. The database interface204 may be configured to access a real-to-VR adjustment database 208 toreceive data specifying adjustment amounts for transitioning real-worldviews. AR views, and VR views between one another. The real-to-VRadjustment database 208 database may include offset directions andamounts for transitioning between displaying the AR image and the VRimage. The database interface 204 may also be configured to access datafrom a location-based database, e.g., a database of parameters regardingplaces where the AR/VR display system 200 is to be used or a map.

The video display 206 may include a 3D head-mounted video display havingone video monitor dedicated to be viewed primarily by one eye andanother video monitor dedicated to be viewed primarily by another eye ofa viewer of the video display 206. For example, the video display 206may include a left display monitor to display an image to a left eye ofa viewer, and a right display monitor to display an image to a right eyeof the viewer. However, this should not be construed as limiting, as insome embodiments, the video display 206 may include only one displaymonitor, which may display both an image associated with the left eyeand an image associated with the right eye of the viewer, or may displaya 2D image on a set of display monitors. The video display 206 maydisplay an AR image and a VR image at different moments in time.

The sensors 210 may include a digital camera or video camera to receiveimages of the environment adjacent to or surrounding the video display206 or within a line of sight of the video display 206, e.g., theenvironment adjacent to or surrounding the viewer 104 or within a lineof sight of the viewer 104 when the viewer 104 is using the videodisplay 206. The environment may be considered to be adjacent to theviewer 104 when the viewer 104 can touch or interact with theenvironment, e.g., when the viewer is seated near another person on atrain and can touch that person or have a conversation with that person.The environment may also be considered to be surrounding the viewer 104when the viewer 104 is able to see the environment, e.g., when theenvironment is within a line of sight of the viewer 104. The displayedimage may be modified to incorporate a representation of the image ofthe environment within a line of sight of the video display 206.

The sensors 210 may also include a microphone to sense audio from theenvironment. The sensors 210 may transmit the images and/or the audio tothe processor 212.

The sensors 210 may also include a motion detector, e.g., anaccelerometer, to detect movement of the video display 206, e.g.,movement of the viewer 104's head when the viewer 104 wears the videodisplay 206 as a head mounted video display. The motion detector mayalso detect other movements of the viewer 104, e.g., the viewer 104sitting down, standing up, or head turning. When the viewer 104 isdetected as sitting down, the processor 212 may control the videodisplay 206 to transition from displaying the AR image to the VR image.When the viewer 104 is detected as standing up, the processor 212 maycontrol the video display 206 to transition from displaying the VR imageto the AR image. When the viewer's head is turned, the processor 212 maycontrol the video display 206 to display a different portion of avirtual or augmented reality environment corresponding to the displayedimage consistent with virtually turning a head of a virtual viewerwithin the virtual or augmented reality environment.

The sensors 210 may also include a proximity sensor to detect proximityof the video display 206 to people or objects in the real-worldenvironment surrounding the video display 206. The sensors 210 may alsoinclude one or more of temperature sensors, humidity sensors, lightsensors, heart rate monitors, vibration sensors, tactile sensors,conductance sensors, etc., to sense the viewer's activities and currentstate, accept input from the viewer 104, and also to sense informationabout the viewer's environment. Based on whether a person is detected tobe adjacent the video display 206 or the viewer 104, the video display206 may be controlled to gradually transition from displaying one of theaugmented reality image and the virtual reality image to the other ofthe augmented reality image and the virtual reality image. For example,when a person is detected to be adjacent the video display 206 or theviewer 104, the video display 206 may be controlled to graduallytransition from displaying the virtual reality image to displaying theaugmented reality image, or be prevented from transitioning to displaythe virtual reality image.

The processor 212 may modify one of the AR image and the VR image whendisplayed on the video display 206 to more closely correspond to theother of the AR image and the VR image. The processor 212 may alsocontrol the video display 206 to transition from displaying the one ofthe AR image and the VR image to the other of the AR image and the VRimage. The gradual transition may include gradually modifying displayedsizes of objects, people, and spaces present in the real-worldenvironment in ways that would reduce disruption of the viewer'sperception of flow, continuity, and consistency as the displayed imagetransitions from one of the VR display and the AR display to the other.These ways may be consistent with differences in a viewer's perceptionsof the real-world environment and the VR environment. For example,elements of an environment on which a viewer's attention is notpresently focused may change without the viewer noticing. Therefore, theprocessor 212 may make changes to the VR environment without the viewernoticing by focusing the viewer's attention to other areas of the VRenvironment than the area that is being changed. The processor 212 maygenerate activity in a region of the VR environment away from the areaof the VR environment that the processor 212 is presently changing inorder to make the change to the VR environment without the viewernoticing.

The processor 212 may also receive the image of the environmentsurrounding the video display 206 from the sensors 210, and modify theimage displayed by the video display 206 to incorporate a representationof the image of the environment received from the sensors 210. Theenvironment may be considered to be adjacent to the viewer 104 when theviewer 104 can touch or interact with the environment, e.g., when theviewer is seated near another person on a train and can touch thatperson or have a conversation with that person. The environment may alsobe considered to be surrounding the viewer 104 when the viewer 104 isable to see the environment, e.g., when the environment is within a lineof sight of the viewer 104.

Using data received from the sensors 210, e.g., a digital camera or aproximity sensor, the processor 212 may detect whether a person isadjacent a viewer of the video display 206. The processor 212 may alsoto determine whether to control the video display to graduallytransition from displaying one of the augmented reality image and thevirtual reality image to the other of the augmented reality image andthe virtual reality image based upon whether a person is detected to beadjacent the viewer. For example, based upon a person being detected tobe adjacent the viewer, the processor 212 may control the video displayto gradually transition from displaying the virtual reality image to theaugmented reality image or to prevent transitioning from displaying theaugmented reality image to the virtual reality image.

The processor 212 may also modify the image displayed by the videodisplay 206 in response to motion sensed by sensors 210.

The processor 212 may detect and track real-world spaces, objects, andpeople in the environment surrounding the video display 206 and revisethe displayed image accordingly. In particular, the processor 212 mayrevise a displayed appearance, size, or location of spaces, objects, andpeople in the displayed image according to the corresponding spaces,objects, and people in the real-world environment.

The processor 212 may look up an offset direction and amount from thereal-to-VR adjustment database 208 and apply the looked-up offsetdirection and amount to the video image displayed by the video display206, which may be one of an AR image and a VR image, in preparation fortransition to the other of the AR image and the VR image. Theapplication of the looked-up offset direction may also be made duringthe transition. For example, the processor 212 may align a size andlocation of a background space in the VR image with a correspondingbackground space in the AR image before or during controlling the videodisplay 206 to transition from displaying the VR image to displaying theAR image. The background space may be a space within a background of therespective image, as would be understood by one of ordinary skill in theart.

For example, the processor 212 may alter an appearance of an aspect ofthe augmented reality image to correspond with a corresponding aspect ofthe virtual reality image while controlling the video display totransition from displaying the augmented reality image to displaying thevirtual reality image. The aspect of the augmented reality image and theaspect of the virtual reality image may each include an object or aspace.

The processor 212 may transition objects in the VR environment intocorresponding objects in the real-world environment as the displayed VRimage is transitioned to the displayed AR image. For example, as theviewer is transitioning from the VR environment to the AR environment,the processor 212 may detect an object in the vicinity of the viewerusing image data received from the sensors 210. The processor 212 maythen use the detected object as an anchor point, or visual landmark, formachine vision to use for aligning the VR environment with real-worldobjects in the AR environment before or while the viewer istransitioning from the VR environment to the AR environment.

Based on image data received from the sensors 210, the processor 212 mayadd a set of virtual objects or avatars in the VR image that correspondwith real-world objects, animals, or people in an environmentsurrounding the video display that are visible in the AR image beforecontrolling the video display 206 to transition from displaying the VRimage to displaying the AR image.

Some characters, objects, or avatars may be assigned to only bepresented in one of the VR environment or the AR environment.Furthermore, some characters, objects, or avatars may be assigned toonly be presented under certain restricted contexts, whether in the VRenvironment or the AR environment. The assignments may be made by theviewer's conscious choice through a user interface presented to theviewer by the processor 212, or may be determined automatically by theprocessor 212 according to characteristics of the characters, objects,or avatars. For example, the viewer may assign virtual birds to the VRenvironment only, or only to contexts in which the viewer is notperforming other activities and is therefore able to concentrate morefully on the VR or AR environment and less on the real-world environmentsurrounding the viewer. This may be because the viewer may find thevirtual birds to be too distracting to be included in the ARenvironment, which the viewer may use while walking or performing otheractivities that require a higher level of concentration on thereal-world environment around the viewer than being seated in a stableand secure environment to enjoy a fully immersive VR environmentexperience.

The processor 212 may also alter an appearance of an object or a spacein the AR image to correspond with a viewer's perceptions of acorresponding object or space in the VR image before controlling thevideo display 206 to transition from displaying the AR image todisplaying the VR image. For example, the processor 212 may elongate aforeground of the AR image in relation to a point of view in the VRimage after controlling the video display 206 to transition fromdisplaying the AR image to displaying the VR image in order tocorrespond with a viewer's perceptions of space in the VR image.Research has shown that a viewer's perceptions of space in VRenvironments differ from the viewer's normal experience of reality. Inparticular, people tend to underestimate the size of virtual spaces inVR environments.

In an embodiment, when the viewer begins viewing the VR environment,e.g., after transitioning from the AR environment, the dimensions ofspaces within the VR environment may match the spaces of the ARenvironment in order to provide a seamless transition for the viewer.However, in order to compensate for the viewer's perceptions of space inVR environments being different from the viewer's normal experience ofreality, the dimensions of spaces within the VR environment may bestretched out, for example, by 5%, 10%, 15%, 20%, or 25%, 30%, or othervalue when the viewer's attention is focused on something other than thespaces that are being stretched out. To focus the attention of theviewer away from the spaces being stretched out so that the viewerdoesn't perceive the change, a character may be presented to the viewerto capture the viewer's attention and direct it away from the spacesthat are being stretched. The process may then be reversed when the VRenvironment is later transitioned to the AR environment.

Using data from the sensors 210 and/or data accessed via the databaseinterface 204, e.g., the viewer's location, the viewer's activity, theviewer's posture, the viewer's calendar schedule, and the viewer's stateof social interaction, the processor 212 may determine whether contextindicates that the displayed image on the video display 206 is about totransition from displaying the one of the AR image and the VR image tothe other of the AR image and the VR image. The viewer's state of socialinteraction may include whether the viewer is adjacent another person ortalking with another person. For example, when there are people nearbythe viewer or the viewer is talking to people, the viewer may wish to bein an AR environment rather than a VR environment in order to payattention to the other people and not be too isolated, withdrawn, orunaware of what the other people are doing.

FIG. 3 is a block diagram illustrating a display controller 300,according to an embodiment. The display controller 300 may be anembodiment of the AR/VR display system 200. The display controller 300may include a set of sensors 302, a context engine 304, an objectdelineator 306, an optional virtual object creator 308, avirtual-to-real object mapper 310, an AR-to-VR and VR-to-AR transitioner312, a video display 314, a VR renderer 316, an AR renderer 318, and areal-to-VR adjustment database 320. The display controller 300 may alsoinclude processor, storage, and communications modules 322. Theprocessor, storage, and communications modules 322 may includeembodiments of the processor 212, the real-to-VR adjustment database208, and the communications interface 202 discussed above with respectto FIG. 2. The storage may also include various types of data storageand memory devices as known in the art (e.g., solid state hard drive,magnetic hard drive, flash drive, or other nonvolatile memory systems;or volatile memory systems such as dynamic random access memory (DRAM)).

The display controller 300 may be incorporated into a head-mounteddisplay communicatively coupled with a separate computer system (e.g., adesktop computer, laptop computer, or wearable computer), or may includea complete self-contained head-mounted computer system. In someembodiments, the display controller 300 may be part of a cloud-basedsystem in which processing and/or databases used by the displaycontroller 300 are provided via the cloud, e.g., a data communicationsnetwork such as the Internet.

The sensors 302 may include a world-facing digital camera and/or videocamera to receive images of the environment adjacent to or surroundingthe video display 310, e.g., the environment adjacent to or surroundingthe viewer when the viewer is using the video display 310. Theenvironment may be considered to be adjacent to the viewer 104 when theviewer 104 can touch or interact with the environment, e.g., when theviewer is seated near another person on a train and can touch thatperson or have a conversation with that person. The environment may alsobe considered to be surrounding the viewer 104 when the viewer 104 isable to see the environment, e.g., when the environment is within a lineof sight of the viewer 104. The digital camera or video camera mayinclude a 2D camera, 3D camera, infrared camera, and/or depth camera.The sensors 302 may also include a microphone to sense audio from theenvironment.

The sensors 120 may also include a motion detector, e.g., anaccelerometer, to detect movement of the video display 102. e.g.,movement of the viewer's head when the viewer 104 wears the videodisplay 102 as a head mounted video display. The sensors 120 may alsoinclude a proximity sensor to detect proximity of the video display 102to people or objects in the real-world environment surrounding the videodisplay 102. The sensors 120 may also include one or more of temperaturesensors, humidity sensors, light sensors, heart rate monitors, vibrationsensors, tactile sensors, conductance sensors, etc., to sense theviewer's activities and current state, accept input from the viewer, andalso to sense information about the viewer's environment.

The context engine 304 may monitor various aspects related to the viewerand the environment to determine a context in which the displaycontroller 300 is operating. The monitored aspects include a schedule ofthe viewer, location of the viewer, social circumstances (e.g., peoplenearby the viewer, talking or other social interactions between theviewer and other people), posture of the viewer (e.g., sitting,standing), activity of the viewer (e.g., walking, exercising), etc.

The object delineator 306 may delineate objects within the environmentthat may also be represented in the VR space. The delineated objects mayalso include animals and people. In addition, the object delineator 306may identify the objects that are delineated.

The optional virtual object creator 308 may scan objects in thereal-world environment and create VR versions of the real-world objects,hereinafter referred to as virtual objects. In embodiments without thevirtual object creator 308, existing 3D virtual object models, forexample, those stored in a database, may be relied upon to representreal-world objects in the VR environment without needing to create thevirtual objects.

The virtual-to-real object mapper 310 maps virtual objects and spaces inthe VR environment to corresponding objects and spaces in the real-worldenvironment. Aspects of the environments that are taken into account inthe mapping are the sizes of the spaces, characters that are present orabsent in each environment, orientation of the environments and theirconstituent objects and spaces, and whether or not the real-worldenvironment is in a vehicle. The virtual-to-real object mapper 310 alsodetermines what alterations to objects and spaces should be made in theVR environment to compensate for known perceptual offsets between thereal-world environment and the VR environment. These known perceptualoffsets include a number of aspects. The purpose of the alterations maybe to align the viewer's perceptions of the VR environment closer toreality.

One of these aspects of perceptual offsets is that viewers typicallyunderestimate distances in virtual spaces in VR environments, so arelatively small percentage offset may make spaces in the VR environmentmore closely match the viewer's expectation of the VR environment. Inaddition, viewers typically over-estimate distances travelled in VRenvironments. Another of these aspects of perceptual offsets is thatviewers typically expect more gain per unit of input in the VRenvironment compared to the real-world environment. To compensate forthis, the virtual-to-real object mapper 310 may accelerate the expectedoptic motion presented to the viewer and therefore cover more virtualdistance per virtual step as compared to real steps in the real-worldenvironment, e.g., accelerate the viewer's travel in the VR environment.A third aspect of perceptual offsets is a set of illusions typicallyexperienced by the viewer. The presence of absence of visual illusionsfor motion also vary the optical motion offsets. Optical motion is aperception of motion created by objects in the visual field movingfurther into the periphery as the viewer moves toward them. Motionillusions and optic flow manipulations may change a viewer's perceptionsin VR environments. For example, some illusions include:

-   1) Layered motion, which is based on the observation that multiple    layers of flow fields moving different directions or at different    speeds may affect the perception of motional globally.-   2) Contour filtering, which exploits approximations of human local    feature processing in visual motion perception.-   3) Change blindness, which is based on briefly blanking out the    viewer's view with interstimulus intervals, which may provoke a    contrast inversion of the afterimage.-   4) Contrast inversion, which is based on the observation that    reversing image contrast affects the output of local motion    detectors.

The AR-to-VR and VR-to-AR transitioner 312 may transition the displayfrom one of an AR display and a VR display to the other. For example,information from the context engine 304 and virtual object creator 308may be processed by the AR-to-VR and VR-to-AR transitioner 312 totransition the displayed image from one of the AR display and the VRdisplay to the other.

The video display 314 may include an augmented display or a fullyimmersive display. For example, the video display 314 may project animage onto etched, transparent glass through which the viewer views thereal-world environment surrounding the viewer.

The VR renderer 316 may generate a graphical rendering of a VRenvironment, for example, the output from the AR-to-VR and VR-to-ARtransitioner 312. The VR renderer 316 may incorporate 3D models ofcharacters and other objects, including those created by the virtualobject creator 310.

The AR renderer 318 may generate a graphical rendering of an ARenvironment, for example, the output from the AR-to-VR and VR-to-ARtransitioner 312. The AR renderer 318 may incorporate 3D models ofcharacters and other objects, including those created by the virtualobject creator 310.

The real-to-VR adjustment database 320 may store offset directions andamounts as described above with respect to the real-to-VR adjustmentdatabase 208. These offset directions are based on the known perceptualoffsets discussed with respect to the virtual-to-real object mapper 310.The specific offsets and correction rates for a given application mayvary compared to other applications of the display controller 300, andthese variations may depend on various factors of the VR environment.For example, a less detailed environment may have a smaller offset thana more detailed environment at least because the availability of opticalmotion elements would be more limited in the in less detailedenvironments.

FIG. 4 is a diagram illustrating a transition from a VR representation410 of a real-world environment to an AR representation 430 of thereal-world environment, according to an embodiment. A robot 415 ispresented in both the VR representation 410 and the AR representation430. To enable a smooth transition between the VR representation 410 andthe AR representation 430, an AR/VR display system (e.g., AR/VR system100, AR/VR display system 200, or display controller 300) may align asize and location of background space in the VR representation 410 withcorresponding background space in the AR representation 430. The AR/VRdisplay system may also detect a set of people or objects 422, 424 fromthe real-world environment and place avatars representing them into atransitioning representation 420 as the VR representation 410transitions to the AR representation 430. There may be fewer of theavatars placed in the transitioning representation 420 than detectedpeople or objects from the real-world environment, and the avatars maybe placed in the transitioning representation 420 at different momentsin time as the transition progresses in order to make the transitionmore gradual and smooth the transition for the viewer's sense ofcontinuity. As the transition is made more gradual, that transition maybe more appealing for various storylines and experiences presentedthrough the VR and AR environments.

FIG. 5 is a diagram illustrating expansion of spaces within a VRenvironment 520 to match viewer perceptions of reality as may beexperienced in an AR environment 510, according to an embodiment. Aviewer may have different perceptions of space within a VR environmentcompared to a real-world environment or AR environment. For example, theviewer may underestimate a size of space within the VR environment. Tocompensate for these different perceptions, the VR environment 520 maybe modified relative to the AR environment 510 by elongating theforeground of the VR image in accordance with a tendency of people tounderestimate spaces within a VR environment. The elongation of theforeground may be performed gradually as the AR environment 510 istransitioned to the VR environment 520. Since some spaces in a VRenvironment are perceptually larger than corresponding spaces in areal-world environment, the elongated foreground in the VR environment520 may more closely match the viewer's expectations for a matchingenvironment when transitioning from the AR environment 510 to the VRenvironment 520.

Differences between a viewer's perception of an AR environment and a VRenvironment may also be accommodated during the viewer's movement withinthe VR environment 520 by manipulating the optical flow and other visualcues as the viewer virtually moves through the VR environment 520.

FIG. 6 is a flow chart illustrating a method 600 of transitioning fromone of an AR environment and VR environment to the other of the ARenvironment and VR environment, according to an embodiment. The order inwhich the operations of method 600 are presented in FIG. 6 should not beconstrued as limiting, as the operations of method 600 may be performedin various orders other than those illustrated in FIG. 6, according tothe understanding of one of ordinary skill in the art. Operations ofmethod 600 may be similar to and have similar characteristics assimilarly named or described operations of other methods discussedherein, e.g., method 700 and method 800.

In an operation 602, one of an AR image and a VR image may be initiallydisplayed on a video display. The AR image and the VR image may bedisplayed on the video display at different moments in time. The videodisplay may display a 3D image including a left image to be viewedprimarily by a left eye of the viewer and a right image to be viewedprimarily by a right eye of the viewer, for example, by a head-mounteddisplay.

In an operation 603, it may be determined based upon context whether anear-term transition of the displayed image to the other of the AR imageand the VR image is indicated. The context may include at least theviewer's location, the viewer's activity, the viewer's posture, theviewer's calendar schedule, and the viewer's state of socialinteraction.

In an operation 604, the one of the AR image and the VR image may bemodified to more closely correspond to the other of the AR image and VRimage that was not initially displayed in operation 602. Themodification of operation 604 may be performed repeatedly on subsequentmodified images in order to effect a gradual transition from displayingthe initially displayed image to the other of the AR image and VR imagethat was not initially displayed in operation 602. An appearance of anaspect of the one of the AR image and the VR image may be altered tocorrespond with a corresponding aspect of the other of the AR image andthe VR image while transitioning from displaying the one of the AR imageand the VR image to the other of the AR image and the VR image. Theaspect may include an object or a space, for example.

In an operation 606, an image of a real-world environment adjacent to orsurrounding the video display and/or the viewer may be received by adigital camera, e.g., a digital still camera or video camera. Theenvironment may be considered to be adjacent to the viewer 104 when theviewer 104 can touch or interact with the environment, e.g., when theviewer is seated near another person on a train and can touch thatperson or have a conversation with that person. The environment may alsobe considered to be surrounding the viewer 104 when the viewer 104 isable to see the environment, e.g., when the environment is within a lineof sight of the viewer 104. The image may then be transmitted to aprocessor for processing.

In an operation 608, a motion of a viewer may be sensed, for example, byprocessing the image of the environment, by a motion detector, or by anaccelerometer. The motion of the viewer may be indirectly sensed bysensing a motion of the video display, e.g., a head-mounted display thatis wom on the viewer's head.

In an operation 610, the one of the AR image and VR image that isinitially displayed in operation 602 may be modified when displayed onthe video display to incorporate a representation of an image of thereal-world environment surrounding the video display and/or the viewer.Intermediate displayed images that are displayed after the one initiallydisplayed image or the other of the AR image and VR image that is notinitially displayed in operation 602 may also be modified when displayedon the video display to incorporate the representation of an image ofthe real-world environment surrounding the video display and/or theviewer. The image of the real-world environment may be that obtained bythe digital camera in operation 606.

The modification of the one of the AR image and VR image that isinitially displayed in operation 602, or the presently displayed image,may be in response to the motion of the viewer sensed in operation 608.The modification of the one of the AR image and VR image that isinitially displayed in operation 602, or the displayed image, mayinclude transitioning from displaying the one of the augmented realityimage and the virtual reality image to the other of the augmentedreality image and the virtual reality image. The sensed motion mayinclude the viewer sitting down, standing up, or head turning. When thesensed motion includes sitting down, for example, modifying the one ofthe AR image and VR image that is initially displayed in operation 602,or the displayed image, may include transitioning from displaying theaugmented reality image to displaying the virtual reality image. Whenthe sensed motion includes standing up, for example, modifying the oneof the AR image and VR image that is initially displayed in operation602, or the displayed image, may include transitioning from displayingthe virtual reality image to displaying the augmented reality image, orpreventing transitioning to displaying the virtual reality image. Whenthe sensed motion includes turning the viewer's head, modifying the oneof the AR image and VR image that is initially displayed in operation602, or the displayed image, may include displaying a different portionof a virtual or augmented reality environment corresponding to thedisplayed image consistent with virtually turning a head of a virtualviewer within the virtual or augmented reality environment.

In an operation 612, whether a person is adjacent to the viewer and/orthe video display may be detected. The person may be considered to beadjacent to the viewer when the viewer can touch or interact with theperson, e.g., when the viewer is seated near another person on a trainand can touch that person or have a conversation with that person. Theperson may be detected from the image of the real-world environmentobtained by the digital camera in operation 606, or may be detected by aproximity sensor. Machine vision and/or face recognition may be used todetect the person. Determining whether to gradually transition fromdisplaying the one of the augmented reality image and the virtualreality image to the other may be based upon whether a person isdetected to be adjacent to the viewer. For example,

In an operation 614, a set of virtual objects or avatars correspondingwith real-world objects or people in the real-world environment adjacentor surrounding the video display and/or viewer may be added to the VRimage. The environment may be considered to be adjacent to the viewer104 when the viewer 104 can touch or interact with the environment,e.g., when the viewer is seated near another person on a train and cantouch that person or have a conversation with that person. Theenvironment may also be considered to be surrounding the viewer 104 whenthe viewer 104 is able to see the environment, e.g., when theenvironment is within a line of sight of the viewer 104. A set ofvirtual objects or avatars may also be specified to only be displayed inone of the AR image and the VR image, or only under certain restrictedcontextual conditions. The specification may be made by the viewer, ormay be automatic according to characteristics of the virtual objects oravatars.

In an operation 616, real-world spaces, objects, and/or people may betracked in the real-world environment adjacent to or surrounding thevideo display and/or the viewer. The environment may be considered to beadjacent to the viewer 104 when the viewer 104 can touch or interactwith the environment, e.g., when the viewer is seated near anotherperson on a train and can touch that person or have a conversation withthat person. The environment may also be considered to be surroundingthe viewer 104 when the viewer 104 is able to see the environment, e.g.,when the environment is within a line of sight of the viewer 104.

In an operation 618, a displayed appearance or location of spaces,objects, and/or people corresponding to the real-world spaces, objects,and/or people tracked in operation 616 may be revised or altered. Therevision may be made according to changes in the location and/or size ofthe tracked real-world spaces, objects, and/or people, to make thedisplayed appearance more similar to the viewer's perceptions of acorresponding spaces, objects, and/or people in a VR image, or toimprove continuity and smoothness of the displayed image as thedisplayed image is modified in operation 604. For example, an objectdisplayed in the VR image may be aligned with a corresponding real-worldobject as the displayed image is modified in operation 604.

In an operation 620, a size and location of a background space in a VRimage may be aligned with a corresponding space in an AR image. Thealignment may be before transitioning from displaying the VR image todisplaying the AR image, or during but before the transitioning iscomplete. In other words, while gradually transitioning from displayingthe VR image to displaying the AR image, the size and location of thebackground space in the VR image may be aligned with the correspondingspace in the AR image.

In an operation 622, a foreground of an AR image may be elongated inrelation to a point of view in the AR image to correspond with theviewer's perceptions of space in a VR image. The foreground of the ARimage may be elongated while the displayed image is modified inoperation 604 from an initially displayed AR image to a VR image. Insome embodiments, a foreground of the VR image may be elongated inrelation to a point of view in the VR image, for example, during orafter transitioning from displaying the AR image to displaying the VRimage.

In an operation 624, an offset direction and amount for transitioningbetween displaying an AR image and a VR image may be looked up in adatabase of offset directions and amounts for transitioning betweendisplaying the AR image and the VR image. The looked-up offset directionand amount may be applied to one of the AR image and the VR image.

In an operation 626, the image displayed on the video display may begradually transitioned from the initial one of the AR image and VR imageto the other of the AR image and VR image that was not initiallydisplayed in operation 602. The transition may be gradual by displayingintermediate images that more closely correspond with the other imagethan the initial image.

For example, the intermediate images may have objects placed atcoordinates closer to the coordinates of the corresponding objects inthe other image than the coordinates of the corresponding objects in theinitial image, or there may be a higher percentage of objects in theintermediate images that correspond with objects in the other image thanin the initial image. Each subsequent intermediate image may moreclosely correspond to the other image than the previously displayedintermediate images during the transition to displaying the other image.Correspondence may also be determined using image processing techniquesthat perform a cross-correlation between images to determine acorrelation coefficient. The higher the correlation coefficient, themore closely the cross-correlated images correspond with each other.

As another example, the intermediate images may be considered to moreclosely correspond with the other image than the initial image becausethe foreground and/or background spaces of the intermediate imagesoverlay the foreground and/or background spaces of the other image withfewer pixels different from one another than the initial image. Theintermediate images may be considered to more closely correspond withthe other image than the initial image because the foreground and/orbackground spaces of the intermediate images are stretched to a lesserpercentage compared to the other image than the initial image.

FIG. 7 is a flow chart illustrating a method 700 of transitioning from aVR environment to an AR environment, according to an embodiment.Operations of method 700 may be similar to and have similarcharacteristics as similarly named or described operations of othermethods discussed herein, e.g., method 600 and method 800.

In an operation 702, a viewer may be presented with a VR experience, forexample via a video display.

In an operation 704, the viewer may be monitored.

In an operation 706, a context of the viewer may be analyzed. It may bedetermined, based on the context, whether a near-term switch to an ARexperience is indicated. If not, then operation 702 will again beperformed. If so, then the method continues to an operation 708.

In operation 708, a VR space may be aligned with a real-worldenvironment and a point of view of the viewer.

In an operation 710, real-world spaces, objects, and people may betracked.

In an operation 712, the real-world spaces, objects, and people may bematched to corresponding spaces, objects, and people in the VRenvironment.

In an optional operation 714, a set of new virtual objects or avatarsmay be created to match corresponding real-world objects or people. Inembodiments in which optional operation 714 is not performed, thevirtual objects or avatars may already exist in the AR/VR display systemand therefore not need to be created.

In an operation 716, virtual objects or avatars may be rendered tocorrespond to real-world objects or people.

In an operation 718, the AR environment may be displayed with a mix ofreal-world and AR elements.

In an operation 720, it may be determined whether the transition fromthe VR experience to the AR experience is complete. If not, thenoperation 710 will again be performed. If so, then the method ends.

FIG. 8 is a flow chart illustrating a method 800 of transitioning froman AR environment to a VR environment, according to an embodiment.Operations of method 800 may be similar to and have similarcharacteristics as similarly named or described operations of othermethods discussed herein, e.g., method 600 and method 700.

In an operation 802, a viewer may be presented with an AR experience,for example via a video display.

In an operation 804, the viewer may be monitored, and a context of theviewer may be determined by monitoring the viewer. The context mayinclude the viewer's location, the viewer's activity, the viewer'sposture, the viewer's calendar schedule, the viewer's state of socialinteraction, etc. The viewer's state of social interaction may includewhether the viewer is adjacent another person, or whether the viewer istalking with or otherwise interacting with another person.

In an operation 806, a context of the viewer may be analyzed. It may bedetermined, based on the context, whether a near-term switch to a VRexperience is indicated, e.g., whether the AR experience will transitionto the VR experience soon. It may be considered to be near-term or soonif the transition will occur within one minute, within two minutes,within three minutes, within four minutes, within five minutes, or othertime period that one of ordinary skill in the art would consider to besoon or near-term. If not, then operation 802 will again be performed.If so, then the method continues to an operation 808.

In operation 808, a VR space may be aligned with a real-worldenvironment and a point of view of the viewer.

In an operation 810, real-world spaces, objects, and people may betracked.

In an operation 812, the real-world spaces, objects, and people may bematched to corresponding spaces, objects, and people in the ARenvironment.

In an optional operation 814, a set of new virtual objects or avatarsmay be created to match corresponding real-world objects or people. Inembodiments in which optional operation 814 is not performed, thevirtual objects or avatars may already exist in the AR/VR display systemand therefore not need to be created.

In an operation 816, virtual objects or avatars may be rendered tocorrespond to real-world objects or people.

In an operation 818, the VR environment may be displayed with theobjects that correspond with the real-world environment.

In an operation 820, the AR space may be displayed to be consistent withviewer perception.

In an operation 822, it may be determined whether the transition fromthe AR experience to the VR experience is complete. If not, thenoperation 820 will again be performed. If so, then the method ends.

Example 1 is an immersive video display system, the system comprising: avideo display to display an image, the image including an augmentedreality image and a virtual reality image at different moments in time;and a processor coupled with the video display, the processor to: modifyone of the augmented reality image and the virtual reality image to moreclosely correspond to the other of the augmented reality image and thevirtual reality image; and control the video display to graduallytransition from displaying the one of the augmented reality image andthe virtual reality image to the other of the augmented reality imageand the virtual reality image.

In Example 2, the subject matter of Example 1 optionally includes theprocessor further to display a set of objects in only one of theaugmented reality image and the virtual reality image.

In Example 3, the subject matter of any one or more of Examples 1-2optionally includes wherein the video display is incorporated into ahead-mounted video display.

In Example 4, the subject matter of any one or more of Examples 1-3optionally includes further comprising a motion sensor to sense motionof a viewer of the video display, the processor further to modify thedisplayed image in response to the sensed motion.

In Example 5, the subject matter of Example 4 optionally includes themodifying of the displayed image including transitioning from displayingthe one of the augmented reality image and the virtual reality image tothe other of the augmented reality image and the virtual reality image.

In Example 6, the subject matter of any one or more of Examples 4-5optionally includes wherein the sensed motion includes sitting down.

In Example 7, the subject matter of Example 6 optionally includes themodifying of the displayed image including transitioning from displayingthe augmented reality image to displaying the virtual reality image.

In Example 8, the subject matter of any one or more of Examples 4-7optionally includes wherein the sensed motion includes standing up.

In Example 9, the subject matter of Example 8 optionally includes themodifying of the displayed image including transitioning from displayingthe virtual reality image to displaying the augmented reality image.

In Example 10, the subject matter of any one or more of Examples 4-9optionally includes the sensed motion including turning a head of theviewer.

In Example 11, the subject matter of Example 10 optionally includes themodifying of the displayed image including displaying a differentportion of a virtual or augmented reality environment corresponding tothe displayed image consistent with virtually turning a head of avirtual viewer within the virtual or augmented reality environment.

In Example 12, the subject matter of any one or more of Examples 1-11optionally includes further comprising a camera to receive an image ofan environment within a line of sight of the video display, theprocessor further to modify the displayed image to incorporate arepresentation of the image of the environment within a line of sight ofthe video display.

In Example 13, the subject matter of Example 12 optionally includes theprocessor further to detect whether a person is adjacent a viewer of thevideo display using the camera and to determine whether to control thevideo display to gradually transition from displaying the one of theaugmented reality image and the virtual reality image to the other ofthe augmented reality image and the virtual reality image based uponwhether a person is detected to be adjacent the viewer.

In Example 14, the subject matter of Example 13 optionally includes theprocessor further to, based upon a person being detected to be adjacentthe viewer, control the video display to gradually transition fromdisplaying the virtual reality image to the augmented reality image orto prevent transitioning from displaying the augmented reality image tothe virtual reality image.

In Example 15, the subject matter of any one or more of Examples 12-14optionally includes the processor further to, using the received imageof the environment within a line of sight of the video display: track atleast one of real-world spaces, objects, and people in the environmentwithin a line of sight of the video display, and revise at least one ofa displayed appearance and location of spaces, objects, and people inthe displayed image corresponding to the tracked at least one ofreal-world spaces, objects, and people.

In Example 16, the subject matter of any one or more of Examples 12-15optionally includes the processor further to detect a real-world objectin an environment within a line of sight of the video display, and aligna corresponding object in the displayed virtual reality image with thereal-world object as the displayed virtual reality image graduallytransitions to the displayed augmented reality image.

In Example 17, the subject matter of any one or more of Examples 1-16optionally includes the processor further to align a size and locationof a background space in the virtual reality image with a correspondingbackground space in the augmented reality image.

In Example 18, the subject matter of any one or more of Examples 1-17optionally includes the processor further to add a set of virtualobjects in the virtual reality image that correspond with real-worldobjects in an environment within a line of sight of the video displaythat are visible in the augmented reality image while controlling thevideo display to transition from displaying the virtual reality image todisplaying the augmented reality image.

In Example 19, the subject matter of Example 18 optionally includeswherein the set of virtual objects includes a set of avatars, andwherein the real-world objects include a set of people corresponding tothe set of avatars in the set of virtual objects.

In Example 20, the subject matter of any one or more of Examples 1-19optionally includes the processor further to alter an appearance of anaspect of the augmented reality image to correspond with a correspondingaspect of the virtual reality image while controlling the video displayto transition from displaying the augmented reality image to displayingthe virtual reality image.

In Example 21, the subject matter of Example 20 optionally includeswherein the aspect of the augmented reality image and the aspect of thevirtual reality image each include an object.

In Example 22, the subject matter of any one or more of Examples 20-21optionally includes wherein the aspect of the augmented reality imageand the aspect of the virtual reality image each include a space.

In Example 23, the subject matter of Example 22 optionally includeswherein altering an appearance of a space in the augmented reality imagecomprises elongating a foreground of the augmented reality image.

In Example 24, the subject matter of any one or more of Examples 1-23optionally includes the processor further to elongate a foreground ofthe augmented reality image in relation to a point of view in theaugmented reality image while controlling the video display totransition from displaying the augmented reality image to displaying thevirtual reality image.

In Example 25, the subject matter of any one or more of Examples 1-24optionally includes the processor further to elongate a foreground ofthe virtual reality image in relation to a point of view in the virtualreality image after controlling the video display to transition fromdisplaying the augmented reality image to displaying the virtual realityimage.

In Example 26, the subject matter of any one or more of Examples 1-25optionally includes further including a database of offset directionsand amounts for transitioning between displaying the augmented realityimage and the virtual reality image, the processor to look up an offsetdirection and amount from the database of offset directions and amountsand apply the looked-up offset direction and amount to one of theaugmented reality image and the virtual reality image.

In Example 27, the subject matter of any one or more of Examples 1-26optionally includes the processor further to determine whether contextindicates a near-term transition from displaying the one of theaugmented reality image and the virtual reality image to the other ofthe augmented reality image and the virtual reality image, the contextincluding at least one of a viewer's location, the viewer's activity,the viewer's posture, the viewer's calendar schedule, and the viewer'sstate of social interaction.

In Example 28, the subject matter of Example 27 optionally includeswherein the viewer's state of social interaction includes whether theviewer is adjacent another person.

In Example 29, the subject matter of Example 28 optionally includes theprocessor further to, based upon another person being detected to beadjacent the viewer, determine that context indicates a near-termtransition from displaying the virtual reality image to the augmentedreality image.

In Example 30, the subject matter of any one or more of Examples 27-29optionally includes wherein the viewer's state of social interactionincludes whether the viewer is talking with another person.

In Example 31, the subject matter of Example 30 optionally includes theprocessor further to, based upon the viewer being detected to be talkingwith another person, determine that context indicates a near-termtransition from displaying the virtual reality image to the augmentedreality image.

Example 32 is a method of transitioning between an augmented realityimage and a virtual reality image, the method comprising: displaying animage, the image including one of an augmented reality image and avirtual reality image at different moments in time on a video display;modifying, by a processor, the one of the augmented reality image andthe virtual reality image to more closely correspond to the other of theaugmented reality image and the virtual reality image; and graduallytransitioning from displaying the one of the augmented reality image andthe virtual reality image to the other of the augmented reality imageand the virtual reality image on the video display.

In Example 33, the subject matter of Example 32 optionally includesdisplaying a set of objects in only one of the augmented reality imageand the virtual reality image.

In Example 34, the subject matter of any one or more of Examples 32-33optionally includes wherein displaying the image on the video displaycomprises displaying a 3D image including a left image to be viewedprimarily by a left eye and a right image to be viewed primarily by aright eye by a head-mounted video display.

In Example 35, the subject matter of any one or more of Examples 32-34optionally includes further comprising: sensing, by a motion sensor, amotion of a viewer of the video display; and modifying the one of theaugmented reality image and the virtual reality image in response to thesensed motion.

In Example 36, the subject matter of Example 35 optionally includeswherein modifying the one of the augmented reality image and the virtualreality image includes transitioning from displaying the one of theaugmented reality image and the virtual reality image to the other ofthe augmented reality image and the virtual reality image.

In Example 37, the subject matter of any one or more of Examples 35-36optionally includes wherein the sensed motion includes sitting down.

In Example 38, the subject matter of Example 37 optionally includeswherein modifying the one of the augmented reality image and the virtualreality image includes transitioning from displaying the augmentedreality image to displaying the virtual reality image.

In Example 39, the subject matter of any one or more of Examples 35-38optionally includes wherein the sensed motion includes standing up.

In Example 40, the subject matter of Example 39 optionally includeswherein modifying the one of the augmented reality image and the virtualreality image includes transitioning from displaying the virtual realityimage to displaying the augmented reality image.

In Example 41, the subject matter of any one or more of Examples 35-40optionally includes the sensed motion including turning a head of theviewer.

In Example 42, the subject matter of Example 41 optionally includeswherein modifying the one of the augmented reality image and the virtualreality image includes displaying a different portion of a virtual oraugmented reality environment corresponding to the displayed imageconsistent with virtually turning a head of a virtual viewer within thevirtual or augmented reality environment.

In Example 43, the subject matter of any one or more of Examples 32-42optionally includes further comprising: receiving, via a camera, animage of an environment within a line of sight of the video display;modifying the displayed image to incorporate a representation of theimage of the environment within a line of sight of the video display.

In Example 44, the subject matter of Example 43 optionally includesdetecting whether a person is adjacent a viewer of the video displayusing the camera; and determining whether to control the video displayto gradually transition from displaying the one of the augmented realityimage and the virtual reality image to the other of the augmentedreality image and the virtual reality image based upon whether a personis detected to be adjacent the viewer.

In Example 45, the subject matter of Example 44 optionally includesbased upon a person being detected to be adjacent the viewer,controlling the video display to gradually transition from displayingthe virtual reality image to the augmented reality image or preventingtransitioning from displaying the augmented reality image to the virtualreality image.

In Example 46, the subject matter of any one or more of Examples 43-45optionally includes further comprising, using the received image of theenvironment within a line of sight of the video display: tracking, by aprocessor, at least one of real-world spaces, objects, and people in theenvironment within a line of sight of the video display; and revising,by a processor, at least one of a displayed appearance and location ofspaces, objects, and people in the displayed image corresponding to thetracked at least one of real-world spaces, objects, and people.

In Example 47, the subject matter of any one or more of Examples 43-46optionally includes further comprising: detecting, by a processor, areal-world object in the environment within a line of sight of the videodisplay; and aligning, by a processor, a corresponding object in thedisplayed virtual reality image with the real-world object while thedisplayed virtual reality image gradually transitions to the displayedaugmented reality image.

In Example 48, the subject matter of any one or more of Examples 32-47optionally includes further comprising aligning, by a processor, a sizeand location of a background space in the virtual reality image with acorresponding background space in the augmented reality image.

In Example 49, the subject matter of any one or more of Examples 32-48optionally includes further comprising adding, by a processor, a set ofvirtual objects in the virtual reality image that correspond withreal-world objects in an environment within a line of sight of the videodisplay that are visible in the augmented reality image whiletransitioning from displaying the virtual reality image to displayingthe augmented reality image.

In Example 50, the subject matter of Example 49 optionally includeswherein the set of virtual objects includes a set of avatars, andwherein the real-world objects include a set of people corresponding tothe set of avatars in the set of virtual objects.

In Example 51, the subject matter of any one or more of Examples 32-50optionally includes further comprising altering, by a processor, anappearance of an aspect of the augmented reality image to correspondwith a corresponding aspect of the virtual reality image whiletransitioning from displaying the augmented reality image to displayingthe virtual reality image.

In Example 52, the subject matter of Example 51 optionally includeswherein the aspect of the augmented reality image and the aspect of thevirtual reality image each include an object.

In Example 53, the subject matter of any one or more of Examples 51-52optionally includes wherein the aspect of the augmented reality imageand the aspect of the virtual reality image each include a space.

In Example 54, the subject matter of Example 53 optionally includeswherein altering an appearance of a space in the augmented reality imagecomprises elongating a foreground of the augmented reality image.

In Example 55, the subject matter of any one or more of Examples 32-54optionally includes further comprising elongating a foreground of theaugmented reality image in relation to a point of view in the augmentedreality image while transitioning from displaying the augmented realityimage to displaying the virtual reality image.

In Example 56, the subject matter of any one or more of Examples 32-55optionally includes further comprising elongating a foreground of thevirtual reality image in relation to a point of view in the virtualreality image after transitioning from displaying the augmented realityimage to displaying the virtual reality image.

In Example 57, the subject matter of any one or more of Examples 32-56optionally includes further comprising: looking up, by a processor, anoffset direction and amount from a database of offset directions andamounts for transitioning between displaying the augmented reality imageand the virtual reality image: and applying, by a processor, thelooked-up offset direction and amount to one of the augmented realityimage and the virtual reality image.

In Example 58, the subject matter of any one or more of Examples 32-57optionally includes further comprising determining whether contextindicates a near-term transition from displaying the one of theaugmented reality image and the virtual reality image to the other ofthe augmented reality image and the virtual reality image, the contextincluding at least one of a viewer's location, the viewer's activity,the viewer's posture, the viewer's calendar schedule, and the viewer'sstate of social interaction.

In Example 59, the subject matter of Example 58 optionally includeswherein the viewer's state of social interaction includes whether theviewer is adjacent another person.

In Example 60, the subject matter of Example 59 optionally includesbased upon another person being detected to be adjacent the viewer,determining that context indicates a near-term transition fromdisplaying the virtual reality image to the augmented reality image.

In Example 61, the subject matter of any one or more of Examples 58-60optionally includes wherein the viewer's state of social interactionincludes whether the viewer is talking with another person.

In Example 62, the subject matter of Example 61 optionally includesbased upon the viewer being detected to be talking with another person,determining that context indicates a near-term transition fromdisplaying the virtual reality image to the augmented reality image.

Example 63 is at least one machine-readable medium includinginstructions, which when executed by a machine, cause the machine toperform operations of any of the methods of Examples 32-62.

Example 64 is an apparatus comprising means for performing any of themethods of Examples 32-62.

Example 65 is a system for transitioning between an augmented realityimage and a virtual reality image, the system comprising: means fordisplaying an image, the image including one of an augmented realityimage and a virtual reality image at different moments in time on avideo display, means for modifying the one of the augmented realityimage and the virtual reality image to more closely correspond to theother of the augmented reality image and the virtual reality image; andmeans for gradually transitioning from displaying the one of theaugmented reality image and the virtual reality image to the other ofthe augmented reality image and the virtual reality image on thedisplaying means.

In Example 66, the subject matter of Example 65 optionally includesmeans for displaying a set of objects in only one of the augmentedreality image and the virtual reality image.

In Example 67, the subject matter of any one or more of Examples 65-66optionally includes wherein the means for displaying the image on thedisplaying means comprises means for displaying a 3D image including aleft image to be viewed primarily by a left eye and a right image to beviewed primarily by a right eye by a head-mounted video display.

In Example 68, the subject matter of any one or more of Examples 65-67optionally includes further comprising: means for sensing a motion of aviewer of the displaying means; and wherein the means for modifying theone of the augmented reality image and the virtual reality image is inresponse to the sensed motion.

In Example 69, the subject matter of Example 68 optionally includeswherein the means for modifying the one of the augmented reality imageand the virtual reality image includes means for transitioning fromdisplaying the one of the augmented reality image and the virtualreality image to the other of the augmented reality image and thevirtual reality image.

In Example 70, the subject matter of any one or more of Examples 68-69optionally includes wherein the sensed motion includes sitting down.

In Example 71, the subject matter of Example 70 optionally includeswherein the means for modifying the one of the augmented reality imageand the virtual reality image includes means for transitioning fromdisplaying the augmented reality image to displaying the virtual realityimage.

In Example 72, the subject matter of any one or more of Examples 68-71optionally includes wherein the sensed motion includes standing up.

In Example 73, the subject matter of Example 72 optionally includeswherein the means for modifying the one of the augmented reality imageand the virtual reality image includes means for transitioning fromdisplaying the virtual reality image to displaying the augmented realityimage.

In Example 74, the subject matter of any one or more of Examples 68-73optionally includes the sensed motion including turning a head of theviewer.

In Example 75, the subject matter of Example 74 optionally includeswherein the means for modifying the one of the augmented reality imageand the virtual reality image includes means for displaying a differentportion of a virtual or augmented reality environment corresponding tothe displayed image consistent with virtually turning a head of avirtual viewer within the virtual or augmented reality environment.

In Example 76, the subject matter of any one or more of Examples 65-75optionally includes further comprising: means for receiving an image ofan environment within a line of sight of the displaying means: and meansfor modifying the displayed image to incorporate a representation of theimage of the environment within a line of sight of the displaying means.

In Example 77, the subject matter of Example 76 optionally includesmeans for detecting whether a person is adjacent a viewer of thedisplaying means using the image receiving means: and means fordetermining whether to control the display means to gradually transitionfrom displaying the one of the augmented reality image and the virtualreality image to the other of the augmented reality image and thevirtual reality image based upon whether a person is detected to beadjacent the viewer.

In Example 78, the subject matter of Example 77 optionally includesmeans controlling the displaying means to gradually transition fromdisplaying the virtual reality image to the augmented reality image orpreventing transitioning from displaying the augmented reality image tothe virtual reality image, based upon a person being detected to beadjacent the viewer.

In Example 79, the subject matter of any one or more of Examples 76-78optionally includes further comprising: means for tracking at least oneof real-world spaces, objects, and people in the environment within aline of sight of the displaying means; and means for revising at leastone of a displayed appearance and location of corresponding spaces,objects, and people in the displayed image corresponding to the trackedat least one of real-world spaces, objects, and people.

In Example 80, the subject matter of any one or more of Examples 76-79optionally includes further comprising: means for detecting a real-worldobject in the environment within a line of sight of the displayingmeans: and means for aligning a corresponding object in the displayedvirtual reality image with the real-world object while the displayedvirtual reality image gradually transitions to the displayed augmentedreality image.

In Example 81, the subject matter of any one or more of Examples 65-80optionally includes further comprising means for aligning a size andlocation of a background space in the virtual reality image with acorresponding background space in the augmented reality image.

In Example 82, the subject matter of any one or more of Examples 65-81optionally includes further comprising means for adding a set of virtualobjects in the virtual reality image that correspond with real-worldobjects in an environment within a line of sight of the displaying meansthat are visible in the augmented reality image while transitioning fromdisplaying the virtual reality image to displaying the augmented realityimage.

In Example 83, the subject matter of Example 82 optionally includeswherein the set of virtual objects includes a set of avatars, andwherein the real-world objects include a set of people corresponding tothe set of avatars in the set of virtual objects.

In Example 84, the subject matter of any one or more of Examples 65-83optionally includes further comprising means for altering an appearanceof an aspect of the augmented reality image to correspond with acorresponding aspect of the virtual reality image while transitioningfrom displaying the augmented reality image to displaying the virtualreality image.

In Example 85, the subject matter of Example 84 optionally includeswherein the aspect of the augmented reality image and the aspect of thevirtual reality image each include an object.

In Example 86, the subject matter of any one or more of Examples 84-85optionally includes wherein the aspect of the augmented reality imageand the aspect of the virtual reality image each include a space, andthe means for altering an appearance of an aspect of the augmentedreality image includes means for altering an appearance of a space inthe augmented reality image.

In Example 87, the subject matter of Example 86 optionally includeswherein the means for altering an appearance of a space in the augmentedreality image comprises means for elongating a foreground of theaugmented reality image.

In Example 88, the subject matter of any one or more of Examples 65-87optionally includes further comprising means for elongating a foregroundof the augmented reality image in relation to a point of view in theaugmented reality image while transitioning from displaying theaugmented reality image to displaying the virtual reality image.

In Example 89, the subject matter of any one or more of Examples 65-88optionally includes further comprising: means for looking up an offsetdirection and amount from a database of offset directions and amountsfor transitioning between displaying the augmented reality image and thevirtual reality image; and means for applying the looked-up offsetdirection and amount to one of the augmented reality image and thevirtual reality image.

In Example 90, the subject matter of any one or more of Examples 65-89optionally includes further comprising means for determining whethercontext indicates a near-term transition from displaying the one of theaugmented reality image and the virtual reality image to the other ofthe augmented reality image and the virtual reality image, the contextincluding at least one of a viewer's location, the viewer's activity,the viewer's posture, the viewer's calendar schedule, and the viewer'sstate of social interaction.

In Example 91, the subject matter of Example 90 optionally includeswherein the viewer's state of social interaction includes whether theviewer is adjacent another person.

In Example 92, the subject matter of Example 91 optionally includesmeans for determining that context indicates a near-term transition fromdisplaying the virtual reality image to the augmented reality image,based upon another person being detected to be adjacent the viewer.

In Example 93, the subject matter of any one or more of Examples 90-92optionally includes wherein the viewer's state of social interactionincludes whether the viewer is talking with another person.

In Example 94, the subject matter of Example 93 optionally includesmeans for determining that context indicates a near-term transition fromdisplaying the virtual reality image to the augmented reality image,based upon the viewer being detected to be talking with another person.

Embodiments may be implemented in one or a combination of hardware,firmware, and software. Embodiments may also be implemented asinstructions stored on a machine-readable storage device, which may beread and executed by at least one processor to perform the operationsdescribed herein. A machine-readable storage device may include anynon-transitory mechanism for storing information in a form readable by amachine (e.g., a computer). For example, a machine-readable storagedevice may include read-only memory (ROM), random-access memory (RAM),magnetic disk storage media, optical storage media, flash-memorydevices, and other storage devices and media.

A processor subsystem may be used to execute the instructions on themachine-readable medium. The processor subsystem may include one or moreprocessors, each with one or more cores. Additionally, the processorsubsystem may be disposed on one or more physical devices. The processorsubsystem may include one or more specialized processors, such as a GPU,a DSP, an FPGA, or a fixed function processor.

Examples, as described herein, may include, or may operate on, logic ora number of components, modules, or mechanisms. Modules may be hardware,software, or firmware communicatively coupled to one or more processorsin order to carry out the operations described herein. Modules may behardware modules, and as such modules may be considered tangibleentities capable of performing specified operations and may beconfigured or arranged in a certain manner. In an example, circuits maybe arranged (e.g., internally or with respect to external entities suchas other circuits) in a specified manner as a module. In an example, thewhole or part of one or more computer systems (e.g., a standalone,client, or server computer system) or one or more hardware processorsmay be configured by firmware or software (e.g., instructions, anapplication portion, or an application) as a module that operates toperform specified operations. In an example, the software may reside ona machine-readable medium. In an example, the software, when executed bythe underlying hardware of the module, causes the hardware to performthe specified operations. Accordingly, the term “hardware module” isunderstood to encompass a tangible entity, be that an entity that isphysically constructed, specifically configured (e.g., hardwired), ortemporarily (e.g., transitorily) configured (e.g., programmed) tooperate in a specified manner or to perform part or all of any operationdescribed herein. Considering examples in which modules are temporarilyconfigured, each of the modules need not be instantiated at any onemoment in time. For example, where the modules comprise ageneral-purpose hardware processor configured using software, thegeneral-purpose hardware processor may be configured as respectivedifferent modules at different times. Software may accordingly configurea hardware processor, for example, to constitute a particular module atone instance of time and to constitute a different module at a differentinstance of time. Modules may also be software or firmware modules,which operate to perform the methodologies described herein.

Circuitry or circuits, as used in this document, may comprise, forexample, singly or in any combination, hardwired circuitry, programmablecircuitry such as computer processors comprising one or more individualinstruction processing cores, state machine circuitry, and/or firmwarethat stores instructions executed by programmable circuitry. Thecircuits, circuitry, or modules may, collectively or individually, beembodied as circuitry that forms part of a larger system, for example,an integrated circuit (IC), system on-chip (SoC), desktop computer,laptop computer, tablet computer, server, smart phone, etc.

FIG. 9 is a block diagram illustrating a machine in the example form ofa computer system 900, within which a set or sequence of instructionsmay be executed to cause the machine to perform any one or more of themethodologies discussed herein, according to an example embodiment. Inalternative embodiments, the machine operates as a standalone device ormay be connected (e.g., networked) to other machines. In a networkeddeployment, the machine may operate in the capacity of either a serveror a client machine in server-client network environments, or it may actas a peer machine in peer-to-peer (or distributed) network environments.The machine may be a wearable device, a personal computer (PC), a tabletPC, a hybrid tablet, a personal digital assistant (PDA), a mobiletelephone, or any machine capable of executing instructions (sequentialor otherwise) that specify actions to be taken by that machine. Further,while only a single machine is illustrated, the term “machine” shallalso be taken to include any collection of machines that individually orjointly execute a set (or multiple sets) of instructions to perform anyone or more of the methodologies discussed herein. Similarly, the term“processor-based system” shall be taken to include any set of one ormore machines that are controlled by or operated by a processor (e.g., acomputer) to individually or jointly execute instructions to perform anyone or more of the methodologies discussed herein.

The computer system 900 includes at least one processor 902 (e.g., acentral processing unit (CPU), a GPU, or both, processor cores, computenodes, etc.), a main memory 904, and a static memory 906, whichcommunicate with each other via a link 908 (e.g., bus). The computersystem 900 may further include a video display unit 910, an alphanumericinput device 912 (e.g., a keyboard), and a user interface (UI)navigation device 914 (e.g., a mouse). In one embodiment, the videodisplay unit 910, input device 912, and UI navigation device 914 areincorporated into a touch screen display. The computer system 900 mayadditionally include a storage device 916 (e.g., a drive unit), a signalgeneration device 918 (e.g., a speaker), a network interface device 920,and one or more sensors (not shown), such as a GPS sensor, compass,accelerometer, gyrometer, magnetometer, or other sensor.

The storage device 916 includes a machine-readable medium 922 on whichis stored one or more sets of data structures and software 924 (e.g.,instructions) embodying or utilized by any one or more of themethodologies or functions described herein. The instructions 924 mayalso reside, completely or at least partially, within the main memory904, within the static memory 906, and/or within the processor 902during execution thereof by the computer system 900, with the mainmemory 904, the static memory 906, and the processor 902 alsoconstituting machine-readable media.

While the machine-readable medium 922 is illustrated in an exampleembodiment to be a single medium, the term “machine-readable medium” mayinclude a single medium or multiple media (e.g., a centralized ordistributed database, and/or associated caches and servers) that storethe one or more instructions 924. The term “machine-readable medium”shall also be taken to include any tangible medium that is capable ofstoring, encoding, or carrying instructions for execution by the machineand that cause the machine to perform any one or more of themethodologies of the present disclosure, or that is capable of storing,encoding, or carrying data structures utilized by or associated withsuch instructions. The term “machine-readable medium” shall accordinglybe taken to include, but not be limited to, solid-state memories, andoptical and magnetic media. Specific examples of machine-readable mediainclude non-volatile memory, including but not limited to, by way ofexample, semiconductor memory devices (e.g., electrically programmableread-only memory (EPROM), electrically erasable programmable read-onlymemory (EEPROM)) and flash memory devices; magnetic disks such asinternal hard disks and removable disks: magneto-optical disks: andCD-ROM and DVD-ROM disks.

The instructions 924 may further be transmitted or received over acommunication network 926 using a transmission medium via the networkinterface device 920 utilizing any one of a number of well-knowntransfer protocols (e.g., HTTP). Examples of communication networksinclude a local area network (LAN), a wide area network (WAN), theInternet, mobile telephone networks, plain old telephone (POTS)networks, and wireless data networks (e.g., Bluetooth, Wi-Fi, 3G, and 4GLTE/LTE-A or WiMAX networks). The term “transmission medium” shall betaken to include any intangible medium that is capable of storing,encoding, or carrying instructions for execution by the machine, andincludes digital or analog communications signals or other intangiblemedia to facilitate communication of such software.

The above Detailed Description includes references to the accompanyingdrawings, which form a part of the Detailed Description. The drawingsshow, by way of illustration, specific embodiments that may bepracticed. These embodiments are also referred to herein as “examples.”Such examples may include elements in addition to those shown ordescribed. However, also contemplated are examples that include theelements shown or described. Moreover, also contemplated are examplesusing any combination or permutation of those elements shown ordescribed (or one or more aspects thereof), either with respect to aparticular example (or one or more aspects thereof), or with respect toother examples (or one or more aspects thereof) shown or describedherein.

Publications, patents, and patent documents referred to in this documentare incorporated by reference herein in their entirety, as thoughindividually incorporated by reference. In the event of inconsistentusages between this document and those documents so incorporated byreference, the usage in the incorporated reference(s) are supplementaryto that of this document; for irreconcilable inconsistencies, the usagein this document controls.

In this document, the terms “a” or “an” are used, as is common in patentdocuments, to include one or more than one, independent of any otherinstances or usages of“at least one” or “one or more.” In addition “aset of” includes one or more elements. In this document, the term “or”is used to refer to a nonexclusive or, such that “A or B” includes “Abut not B,” “B but not A,” and “A and B,” unless otherwise indicated. Inthe appended claims, the terms “including” and “in which” are used asthe plain-English equivalents of the respective terms “comprising” and“wherein.” Also, in the following claims, the terms “including” and“comprising” are open-ended; that is, a system, device, article, orprocess that includes elements in addition to those listed after such aterm in a claim are still deemed to fall within the scope of that claim.Moreover, in the following claims, the terms “first,” “second,” “third,”etc. are used merely as labels, and are not intended to suggest anumerical order for their objects.

The above description is intended to be illustrative, and notrestrictive. For example, the above-described examples (or one or moreaspects thereof) may be used in combination with others. Otherembodiments may be used, such as by one of ordinary skill in the artupon reviewing the above description. The Abstract is to allow thereader to quickly ascertain the nature of the technical disclosure. Itis submitted with the understanding that it will not be used tointerpret or limit the scope or meaning of the claims. Also, in theabove Detailed Description, various features may be grouped together tostreamline the disclosure. However, the claims may not set forth everyfeature disclosed herein as embodiments may feature a subset of saidfeatures. Further, embodiments may include fewer features than thosedisclosed in a particular example. Thus, the following claims are herebyincorporated into the Detailed Description, with each claim standing onits own as a separate embodiment. The scope of the embodiments disclosedherein is to be determined with reference to the appended claims, alongwith the full scope of equivalents to which such claims are entitled.

What is claimed is:
 1. An immersive video display system, the systemcomprising: a video display to display, to a viewer, an augmentedreality image in an augmented reality environment, or a virtual realityimage in a virtual reality environment; and a processor coupled with thevideo display, the processor to: modify the augmented reality image orthe virtual reality image to more closely correspond to the other,wherein portions of the virtual reality image are stretched by apercentage when the viewer's attention is focused on non-stretchedportions of the virtual reality image, and wherein images in aforeground and background of the virtual reality environment arestretched less than images in an intermediate image based on acorrelation coefficient with a higher correlation coefficient results inless stretching and a lower correlation coefficient results in morestretching; and control the video display to gradually transitionbetween the augmented reality image and the virtual reality image,wherein the processor is to add a set of virtual objects in the virtualreality image that correspond with real-world objects in an environmentwithin a line of sight of the video display that are visible in theaugmented reality image while controlling the video display totransition from displaying the virtual reality image to displaying theaugmented reality image.
 2. The system of claim 1, wherein the videodisplay is incorporated into a head-mounted video display.
 3. The systemof claim 1, further comprising a motion sensor to sense motion of aviewer of the video display, the processor further to modify thedisplayed augmented reality or virtual reality image in response to thesensed motion.
 4. The system of claim 3, the modifying of the displayedaugmented reality or virtual reality image including transitioning fromdisplaying the one of the augmented reality image and the virtualreality image to the other of the augmented reality image and thevirtual reality image.
 5. The system of claim 1, further comprising acamera to receive an image of the environment within the line of sightof the video display, the processor further to modify the displayedaugmented reality or virtual reality image to incorporate arepresentation of the image of the environment within the line of sightof the video display.
 6. The system of claim 5, the processor further todetect whether a person is adjacent a viewer of the video display usingthe camera and to determine whether to control the video display togradually transition from displaying the one of the augmented realityimage and the virtual reality image to the other of the augmentedreality image and the virtual reality image based upon whether a personis detected to be adjacent the viewer.
 7. The system of claim 6, theprocessor further to, based upon a person being detected to be adjacentthe viewer, control the video display to gradually transition fromdisplaying the virtual reality image to the augmented reality image orto prevent transitioning from displaying the augmented reality image tothe virtual reality image.
 8. The system of claim 1, further including adatabase of offset directions and amounts for transitioning betweendisplaying the augmented reality image and the virtual reality image,the processor to look up an offset direction and amount from thedatabase of offset directions and amounts and apply the looked-up offsetdirection and amount to one of the augmented reality image and thevirtual reality image.
 9. The system of claim 1, the processor furtherto determine whether context indicates a near-term transition fromdisplaying the one of the augmented reality image and the virtualreality image to the other of the augmented reality image and thevirtual reality image, the context including at least one of a viewer'slocation, the viewer's activity, the viewer's posture, the viewer'scalendar schedule, and the viewer's state of social interaction.
 10. Amethod of transitioning between an augmented reality image and a virtualreality image, the method comprising: displaying, to a viewer, anaugmented reality image in an augmented reality environment, or avirtual reality image in a virtual reality environment on a videodisplay; modifying, by a processor, either the augmented reality imageor the virtual reality image to more closely correspond to the other,wherein portions of the virtual reality image are stretched by apercentage when the viewer's attention is focused on non-stretchedportions of the virtual reality image to provide perceptualcompensation, and wherein images in a foreground and background of thevirtual reality environment are stretched less than images in anintermediate image based on a correlation coefficient with a highercorrelation coefficient results in less stretching and a lowercorrelation coefficient results in more stretching; graduallytransitioning between the augmented reality environment and the virtualreality environment by modifying the display of the augmented realityimage or the virtual reality image to the other on the video display;and adding a set of virtual objects in the virtual reality image thatcorrespond with real-world objects in an environment within a line ofsight of the video display that are visible in the augmented realityimage while transitioning from displaying the virtual reality image todisplaying the augmented reality image.
 11. The method of claim 10,further comprising: sensing, by a motion sensor, a motion of a viewer ofthe video display, wherein the sensed motion includes sitting down; andmodifying the one of the augmented reality image and the virtual realityimage in response to the sensed motion.
 12. The method of claim 11,wherein modifying the one of the augmented reality image and the virtualreality image includes transitioning from displaying the augmentedreality image to displaying the virtual reality image.
 13. The method ofclaim 10, further comprising: sensing, by a motion sensor, a motion of aviewer of the video display, wherein the sensed motion includes standingup; and modifying the one of the augmented reality image and the virtualreality image in response to the sensed motion.
 14. The method of claim13, wherein modifying the one of the augmented reality image and thevirtual reality image includes transitioning from displaying the virtualreality image to displaying the augmented reality image.
 15. The methodof claim 10, further comprising: sensing, by a motion sensor, a motionof a viewer of the video display, wherein the sensed motion includesturning a head of the viewer; and modifying the one of the augmentedreality image and the virtual reality image in response to the sensedmotion, wherein modifying the one of the augmented reality image and thevirtual reality image includes displaying a different portion of avirtual or augmented reality environment corresponding to the displayedaugmented reality or virtual reality image consistent with virtuallyturning a head of a virtual viewer within the virtual or augmentedreality environment.
 16. The method of claim 10, further comprising:receiving, via a camera, an image of the environment within the line ofsight of the video display; modifying the displayed augmented reality orvirtual reality image to incorporate a representation of the image ofthe environment within a line of sight of the video display; tracking,by a processor, at least one of real-world spaces, objects, and peoplein the environment within the line of sight of the video display, usingthe received image of the environment; and revising, by a processor, atleast one of a displayed appearance and location of spaces, objects, andpeople in the displayed augmented reality or virtual reality imagecorresponding to the tracked at least one of real-world spaces, objects,and people, using the received image of the environment.
 17. The methodof claim 10, further comprising: receiving, via a camera, an image ofthe environment within the line of sight of the video display; modifyingthe displayed augmented reality or virtual reality image to incorporatea representation of the image of the environment within the line ofsight of the video display; detecting, by a processor, a real-worldobject in the environment within the line of sight of the video display;and aligning, by a processor, a corresponding object in the displayedvirtual reality image with the real-world object while the displayedvirtual reality image gradually transitions to the displayed augmentedreality image.
 18. The method of claim 10, further comprising: lookingup, by a processor, an offset direction and amount from a database ofoffset directions and amounts for transitioning between displaying theaugmented reality image and the virtual reality image; and applying, bya processor, the looked-up offset direction and amount to one of theaugmented reality image and the virtual reality image.
 19. The method ofclaim 10, further comprising determining, by a processor, whethercontext indicates a near-term transition from displaying the one of theaugmented reality image and the virtual reality image to the other ofthe augmented reality image and the virtual reality image, the contextincluding at least one of a viewer's location, the viewer's activity,the viewer's posture, the viewer's calendar schedule, and the viewer'sstate of social interaction.
 20. At least one non-transitorymachine-readable medium including instructions, which when executed by amachine, cause the machine to perform operations comprising: displaying,to a viewer, an augmented reality image in an augmented realityenvironment, or a virtual reality image in a virtual reality environmenton a video display; modifying either the augmented reality image or thevirtual reality image to more closely correspond to the other, whereinportions of the virtual reality image are stretched by a percentage whenthe viewer's attention is focused on non-stretched portions of thevirtual reality image to provide perceptual compensation, and whereinimages in a foreground and background of the virtual reality environmentare stretched less than images in an intermediate image based on acorrelation coefficient with a higher correlation coefficient results inless stretching and a lower correlation coefficient results in morestretching; gradually transitioning between the augmented realityenvironment and the virtual reality environment by modifying the displayof the augmented reality image or the virtual reality image to the otheron the video display; and adding a set of virtual objects in the virtualreality image that correspond with real-world objects in an environmentwithin a line of sight of the video display that are visible in theaugmented reality image while transitioning from displaying the virtualreality image to displaying the augmented reality image.
 21. Thenon-transitory machine-readable medium of claim 20, further comprisingaligning, by a processor, a size and location of a background space inthe virtual reality image with a corresponding background space in theaugmented reality image.
 22. The non-transitory machine-readable mediumof claim 20, further comprising adding, by a processor, a set of virtualobjects in the virtual reality image that correspond with real-worldobjects in the environment within the line of sight of the video displaythat are visible in the augmented reality image while transitioning fromdisplaying the virtual reality image to displaying the augmented realityimage.
 23. The non-transitory machine-readable medium of claim 20,further comprising altering, by a processor, an appearance of an aspectof the augmented reality image to correspond with a corresponding aspectof the virtual reality image while transitioning from displaying theaugmented reality image to displaying the virtual reality image.
 24. Thenon-transitory machine-readable medium of claim 20, further comprisingelongating, by a processor, a foreground depth of the augmented realityimage in relation to a point of view in the augmented reality imagewhile transitioning from displaying the augmented reality image todisplaying the virtual reality image.
 25. The non-transitorymachine-readable medium of claim 20, further comprising elongating, by aprocessor, a foreground depth of the virtual reality image in relationto a point of view in the virtual reality image after transitioning fromdisplaying the augmented reality image to displaying the virtual realityimage.